Introduction to Turing Machines 


SITE: http://www.sir.blols.univ-tours.fr/ mirian/ 
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Problems that computers cannot solve 


9 Problem: What a program does? 


® Not knowing when, if ever, something will occur is the ultimate 
cause of our inability to tell what a program does 


Automata Theory. Languages and Computation - Mírian Halfeld-Ferrari — p. 2/2 


Programs that print "Hello, Word" (1) 


Kernighan and Ritchie's hello-world program 


main() 
{ 
printf ("Hello, world"); 


} 
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Programs that print "Hello, Word" (2) 
Femat'’s last theorem expressed as a hello-world program 


main() 
{ 
int n, total, x, Y, Z; 
scanf("$", &n); 
total = 3; 


while (1) í 
for (x = 1; x <= total -2; x++) 


for (y = 1; y <= total -1 ; y++) { 
z = total — x -y; 
if (exp(x, n) + exp (y, n) == exp(z, n)) 
printf ("hello, word"); 
) 
total ++ 
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Programs that print "Hello, Word" (3) 


The program (Fermat) takes an input n and looks for positive integer solutions to 
equation 


r” +y” = z" 


9 Ifthe program finds a solution, it prints hello, world 


® lf it never finds integer x, y, z to satisfy the equation, then it continues searching 
forever, and never prints hello, world 


If the value of n is 2, then it will find combinations of integers and thus: 
For input n = 2 the program prints hello, world 


For any integer n > 2, the program will never find a triple of positive integers to 
satisfy x” + y” = z” (300 years to prove!) 
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Our hello-world problem 


Determine whether a given C program, with a given input, 
prints hello, world as the first 12 characters that it prints 


9 İs it possible to have a program that proves the correction of 
programs? 


® Any of the problems that mathematicians have not been able 
to resolve can be turned into a question of the form 


Does this program, with this input, print hello, world? 


9 ls it possible to have a program that could examine any 
program P and input J for P, and tell whether P, run with J as 
its input, would print hello, world? 
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The Hypothetical "Hello World'' Tester 


No 


EP 


® Assume there is a program (H) that takes as input 
$ A program P 
® Input] 
and tells whether P within input I prints hello, world 
(Output is either Yes or No) 


-8 ifa problem has an algorithm like H, that always tells correctly whether an instance 
of the problem has answer Yes or No, then the problem is said to be decidable. 
Otherwise, the problem is undecidable. 


-8 GOAL: To prove that H does not exist (proof by contradiction). 
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The Hypothetical "Hello World"' Tester 


hello, word 


® Assume H exists. 


® First modification: H1 prints hello, world exactly when H would print No 
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The Hypothetical "Hello World" Tester 


hello, word 


® We want to restrict H1 so it: 


® Takes only input P, not P and J. 


® Asks what P would do if its inputs were its own code, i.e., what would H1 do on 
inputs P as program and P as input / as well? 


® Second modification: 


-9 H2 first reads the entire input P and stores it in an array A. 


- H2then simulates H1 but whenever H1 would read input from P or I, H2 
reads from the stored copy in A. 
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e © 


How can we prove that H2 cannot exist? 


hello, word 


H2 


What H2 does when given itself as input? 
H2, given any program P as input: 


® Makes output Yes if P prints hello, world when given itself as input. 
$ Prints hello, world if P (given itself as input) does not print hello, world. 


Suppose that H2 makes the output Yes: Then the H2 in the box is saying about its 
input H2 that H2 (given itself as input) prints hello, world as its first output. 
But we just supposed that the first output H2 makes in this situation is Yes! 


Thus it appears that the output of the box above is hello, world. 
But if H2 (given itself as input) prints hello, world, then the output of the box must 
be Yes 


Whichever output we suppose H2 makes, we can argue that it makes the other 
output. A PARADOX!!!! 
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Undecidable Problems and Reduction 


9 A problem that cannot be solved by computer is called 
undecidable 


$ A problem is the question of deciding whether a given 
string is a member of some particular language. 


® How to prove that a given problem is undecidable? 


$ Once we have one problem that we know is undecidable, 
we no longer have to prove the existence of a paradoxical 
situation. 
It is sufficient to show that if we could solve the new 
problem, then we could use that solution to solve a 
problem we already know is undecidable 


9 This strategy is called reduction 
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Reduction of P, to P, 


P, YES 
Instance 


P 
Instance 


Undecidable 
NO 


Let P, be an undecidable problem (we know that) 
Let P» be a new problem that we would like to prove is undecidable as well 
® We invent a construction that converts instances of P into instances of P», i.e.: 


® any string in the language Pi is converted into a string un the language P> and 


® and any string that is not in the language of P is converted into a string that is 
not in the language of P5. 
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Reduction of P, to P, 


Once we have this construction, we can solve P. as follows: 
® Given an instance of P, i.e., given a string w that may or may not be in the 
language P, apply the construction algorithm to produce a string z. 
® Test whether z is in P2, and give the same answer about w and P1. 
If w € Pı, then x € P2; so the algorithm says YES 
If w Z Pı, then x ¢ P2; so the algorithm says NO 


Since we assumed that NO algorithm to decide the membership of a string in Pj 
exists, we have a proof BY CONTRADICTION, that the hypothetical decision 
algorithm for P5 does not exist 

P> is undecidable 


What are you doing? 


x 


< 


We prove that: 
If P5 is decidable then P1 is decidable 


This is the same as to prove the contrapositive of the above statement: 
If P, is undecidable then P5 is undecidable 
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Propose of the theory of undecidable problems 


To provide guidance to programmers about what they might or might not be able to 
accomplish through programming 


Pragmatic impact: 
® Intractable problems: 


® Decidable problems. 
® Require large amount of time to solve them. 


- Contrary to undecidable problems, which are usually rarely attempted in 
practice, the intractable problems are faced everyday. 


® Yield to small modifications in the requirements or to heuristc solutions. 


® We need tools that allow us to prove everyday questions undecidable or intractable 


-8 We need to rebuild our theory of undecidability, based not on C programs, but based 
on a very simple model of computer called Turing Machine 
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The Turing Machine 


Informally... 
® TMis essentially a finite automaton that has a single tape of infinite length on 
which it may read and write data. 


® Advantage of TM over programs as representation of what can be computed: TM is 
sufficiently simple that we can represent its configuration precisely, using a simple 
notation much like ID's of a PDA. 


History 


® 1936: Alan Turing proposed the TM as a model of any possible computation. 


® This model is computer-like, rather than program-like, even though true electronic or 
electromechanical computers were several years in the future. 


® All the serious proposals for a model of computation have the same power; i.e., they 
compute the same functions and recognize the same languages. 
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Notation for the TM 


eee ee t 


Finite control: can be in any of a finite set of states 


Tape: divided into cells; each cell can hold one of a finite number of symbols. 
Initially the input (a finite-length string) is placed on the tape 

All other tape cells initially hold a special symbol: blank 

Blank is tape symbol (not an input symbol) 


Tape head: always positioned at one of the tape cell. Initially, the tape head is at the 
leftmost cell that holds the input. 
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A move of the TM 


A move of the TM is a function of the state of the finite control and 
the tape symbol scanned. In one move the TM will 


1. Change state 
2. Write a tape symbol in the cell scanned. 
3. Move the tape head left or right 
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TM: Formal notation 


M — (Q, 3, 1,0, go, B, F) 


Q: The finite set of states of the finite control 
>: The finite set of input symbols 


T: The complete set of tape symbols; 
> is always a subset of T 


ó: The transition function 
The arguments of ó(q, X) are: a state q and a tape symbol X. 
The value of ó(q, X), if it is defined, is (p, Y, D) where: 


9 pisthe next state, in Q 


® Y isthe symbol, in I’, written in the cell being scanned, replacing whatever 
symbol was there. 


9 D isa direction (either L or R), telling us the direction in which the head moves. 
qo: The start state (qo € Q) in which the finite control is found initially. 
B: blank symbol (B € T but B g >°). 
F: the set of final or accepting states (F C Q). 
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Instantaneous Descriptions for TM 


We use the instantaneous description to describe the configuration. 
An ID is represented by the string: 

X1X9 Pare Ay JQ AA 11 oe Xn 
where: 


1. g is the state of the TM. 
2. The tape head is scanning the ith symbol from the left. 


3. X4X»5... X, is the portion of the tape between the leftmost 
and the rightmost nonblank 
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Moves (1) 


® let M =(Q,»,T,6,q0, B, F). 
-8 We use the notation | 4; (or +) to represent moves of a TM M from one configuration 
to another. 


E 
® |, is used as usual. 


The next move is leftward: 
If ó(q, Xi) = (p, Y, L) then: 


KIXI Xit GAGA i Xn FM XIXa- X o p KX; 1 Y Ain Xn 


Exceptions: 
1. Ifi = 1, then M moves to the blank to the left of X1 
qX1X2...Xu Fm p BY Xa... Xa 
2. Ifi = n and Y = B, then the symbol B written over Xn joins the infinite sequence of 


trailing blanks and does not appear in the next ID. 


X1..-Xn-19Xn Fy X1X2... X452 p Xn-1 
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Moves (2) 


The next move is rightward: 
If ó(q, Xi) = (p, Y, L) then: 


AAG sas RG Ai X ce Ay PM ATX Xi- Xii Y p AG it XA 


Exceptions: 


1. If¿ = n then the i + 1st cell holds a blank, and that cell was not part of the previous 
ID. 


Xi Rat ha he X X Xa YB 


2. Ifi = 1andY = B, then the symbol B written over X; joins the infinite sequence of 
trailing blanks and does not appear in the next ID. 


q X1X2...Xn Fa Dp AX sas XA 
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A TM for the language 10"1" | n > 1} 


M — (qo; qi, 92, 3; q4}, 10, i! 10, LA; y, By, Ô, qo; b, {qa}) 


State Symbol 
qo (qı, X, R) - 7 (qa; Y, R) ] 
qi (31,0, R) — (q2, Y L) : (q1, Y, R) - 
q2 (q2, 0, L) à (qo, X, R) (qo, Y; L) à 
q3 = a (qg, Y, R) (qa, B, R) 
q4 š 2 s š : 
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Transition diagram for TM 


A > 
0/0 — 
NS E: - ) > Y/Y — 
9 di yo 
Y/Y = X es 


Y/Y > 


go0011 + Xq1011 F XOqi11 F Xq30Y1 + q2 X0Y1 F Xqg0Y1 
F XXqiY1 H XXYq1 + XXg;YY F XgoXYY E XXqoYY 
F XXYqsY F XXYYq4B - XXYY Bq4B 
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The language of a TM 


Let M = (Q,»,T,6,q0, B, F) be a TM. Then L(M ) is the set of 
strings w € X* such that 


qawrapp 
for some state p c F and any tape string o and 0. 
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The language of a TM 


The set of languages we can accept using a TM is often called the recursively 
enumerable languages or RE languages. 


There is another notion of acceptance that is commonly used for TM: acceptance by 
halting. 

We say a TM halts if it enters a state q scanning a tape symbol X, and there is no 
move in this situation, i.e., ó(q, X) is undefined. 


$ We can always assume that a TM halts if it accepts 
® Unfortunately, it is not always possible to require that a TM halts even if it does 
not accept 


Recursive languages: Languages for which TM do halt, regardless of whether or 
not they accept 

TM that always halt, regardless of whether or not they accept, are good model of an 
algorithm 


If an algorithm to solve a given problem exists, then we say the problem is decidable. 
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Alan Turing, the father of modern computer science. - Biography 


e June 23, 1912 - June 7, 1954: English mathematician, logician, and cryptographer 

e With the Turing test, Turing made a significant and characteristically provocative 
contribution to the debate regarding artificial intelligence: whether it will ever be possible to 
say that a machine is conscious and can think. 

e He provided an influential formalisation of the concept of the algorithm and computation 
with the Turing machine, formulating the now widely accepted "Turing" version of the 
Church-Turing thesis: any practical computing model has either the equivalent or a 
subset of the capabilities of a Turing machine. 

e During World War ll, Turing worked at Britain's code breaking centre, and was for a time 
head of the section responsible for German Naval cryptanalysis. He devised a number of 
techniques for breaking German ciphers, including the method of the bombe, an 
electromechanical machine which could find settings for the Enigma machine. 

e After the war, he worked at the National Physical Laboratory, creating one ofthe first 
designs for a stored-program computer, although it was never actually built. In 1947 he 
moved to the University of Manchester to work, largely on software, on the Manchester Mark 
| then emerging as one of the world's earliest true computers. 

e In 1952, Turing was convicted of "acts of gross indecency" after admitting to a sexual 
relationship with a man in Manchester. He was placed on probation and required to undergo 
hormone therapy. Turing died after eating an apple laced with cyanide in 1954, sixteen days 
short of his 42nd birthday. His death is regarded by most as an act of suicide. 
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